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Abstract 

As teachers, administrators, and members of intervention teams use student performance data to 
inform instructional decisions and monitor implementation of tiered instruction in a Response to 
Intervention (RTI) model, assuring fidelity of implementation or treatment integrity continues to 
be a challenge. This article describes how one school district established a model of RTI includ- 
ing three mechanisms to enhance data-driven instruction and fidelity of implementation through 
the use of: (1) a student intervention tracking form, (2) reading coaches, and (3) teacher-made 
video clips. 
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Background: Scenario 

Three years ago, Ms. Sullivan and Ms. 
Easton submitted their lesson plans each 
week to their school principal for their co- 
taught second grade class. They had clear, 
behavioral objectives for each lesson. They 
taught the lessons, recorded students’ grades, 
and determined the next objectives in the cur- 
ricular scope and sequence. Ms. Sullivan saw 
herself as the second grade teacher responsi- 
ble for most of the students, while Ms. Eas- 
ton, as the special education teacher, saw her- 
self responsible for students struggling with 
academic or behavior challenges. If a student 
had significant academic or behavioral chal- 
lenges, the teachers would refer the student to 
the child study team for a comprehensive 
evaluation. 

Today, the portion of this scenario that 
remains the same is the teachers submit 
weekly lesson plans. Over the past three years 
much has changed for Ms. Sullivan and Ms. 
Easton and their colleagues in improving in- 
struction for all students in their school. Nei- 
ther sees herself as the general or special edu- 
cation teacher. Rather, they see themselves as 
two, fully empowered teachers in this co- 
taught class. In addition, they assess each stu- 
dent’s skill level in the critical elements of 
reading three times per year (benchmark as- 
sessment data). For the four students in their 
class not making the anticipated growth in 
reading decoding and fluency, the teachers 
maintain additional documentation (progress 
monitoring data) and the students receive ex- 
tra and more intense instruction, individually 
or in small groups in this general education 
setting. Ms. Sullivan and Ms. Easton, using 
the school’s student intervention tracking 
form located on a clipboard in front of them, 
document student progress and fidelity of im- 


plementation by noting (1) instructional 
interventions, (2) frequency (# of days/ 
week), (3) duration (# of minutes/session), 
(4) intensity (individual or # of students/ 
group), and (5) how, if at all, they deviated 
from the intervention plan. 

In this group of four, second grad- 
ers who are struggling with reading decod- 
ing and fluency, Ms. Sullivan and Ms. 
Easton are particularly concerned about 
Gregory’s progress. They are so concerned 
that they have referred him to the school’s 
Intervention Team made up of a general 
educator, special educator, child study 
team member, and, in this case, a reading 
specialist, to review and discuss (1) 
whether or not his level or tier of interven- 
tion should continue, (2) if other strategies 
should be implemented, or (3) if Gregory 
should be considered for more intensive 
instruction. In all likelihood, three years 
ago Gregory would have just been referred 


“For the four students in the 
class not making the anticipated 
growth in reading decoding and 
fluency, the teachers maintain 
additional documentation and 
the students receive extra and 
more intense instruction.” 

V 

for classification as a student eligible for 
special education. Now, Ms. Sullivan and 
Ms. Easton look forward to colleague’s 
feedback on possible next steps to better 
assist Gregory within their classroom and 
to collaboratively discuss his needs based 
upon specific data about his reading de- 
coding and fluency performance. In short, 
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Gregory is provided with several opportuni- 
ties to receive more intense, documented in- 
struction. In other cases, clear evidence will 
exist that a direct referral for a comprehensive 
evaluation to determine if special education 
services is warranted (CEC, 2007). 

Establishing and Piloting RTI 

Ms. Sullivan and Ms. Easton’s in- 
struction for Gregory is part of tiered instruc- 
tion. This is an essential part of the Response 
to Intervention (RTI) model being imple- 
mented in this 8,000 pupil, lower- middle so- 
cioeconomic status school district in southern 
New Jersey. This is the fourth year their dis- 
trict has used RTI, a multi-tiered approach to 
meeting students’ academic and behavioral 
needs. 

RTI has three basic required features 
(Brown-Chidsey & Steege, 2005; Fuchs & 
Fuchs, 2001; NASDSE, 2005; NRCLD, 
2003). The first component is matching high 
quality research-based intervention to stu- 
dent’s educational and behavioral needs. 
Second, progress monitoring is used to assess 
the need for changes in instruction or goals. 
Third, student response’s from progress moni- 
toring data is the basis of important educa- 
tional decisions, which might include addi- 
tional levels or tiers of instructional intensity 
or possibly eligibility for special education. 

The RTI model moves students to 
progressively higher tiers of intervention, if 
they are not successful in the general educa- 
tion classroom using research-based or Tier I 
instruction. If Tier I in the general education 
classroom is not producing sufficient enough 
success, students are moved to subsequently 
higher tiers until progress is achieved at a rate 
sufficient enough to show progress toward a 
predetermined goal. This is called Tier II. 


Finally they are moved in order to receive 
more intense intervention or to determine 
if they are eligible for specialized services. 
This final level is called Tier III. 

RTI is a system of educational re- 
design based upon a hierarchy of interven- 
tions. For this school district it is designed 
to meet the needs of students who demon- 
strate underachievement in literacy. This 
district’s RTI model will eventually be 
broadened to encompass other academic 
subject areas and behavioral issues as the 
district’s knowledgebase increases, skills 
are honed, and teachers, parents, adminis- 
trators, and staff establish a level of suc- 
cess and comfort. Professional develop- 
ment is now underway in this district to 
enable RTI to address mathematics as well 
as behavioral issues. 

The district initiated the RTI proc- 
ess four years ago in kindergarten and has 
added an additional grade level each year. 
Third grade is on-board this year for the 
first time. For a year prior to initiating 
RTI, administrators and teachers in general 
and special education met to marry the 
best of both general and special education. 
All agreed on a need for a new paradigm, 
endorsing the RTI model. The district pro- 
vided professional development to teach- 
ers and staff in their pilot school for a year 
prior to implementation. The professional 
development included review of protocols 
for evidenced-based practices: curriculum- 
based measurement (including progress 
monitoring), benchmark assessments, and 
a problem-solving approach to RTI. As the 
district expanded RTI to include subse- 
quent grades they have provided additional 
and refined training. For example, this 
year in second grade, the district added 
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data collection for reading comprehension, 
using guided reading. 

The district conducted research to find 
a measure designed to elicit the data neces- 
sary to make informed decisions about stu- 
dent progress in early reading (Elliott, Lee, 
Tollefson, 2001; and Good, Simmons, & 
Kame’enui, 2001), and Dynamic Indicators of 
Basic Early Literacy (DIBELS) was selected. 
DIBELS (University of Oregon Center on 
Teaching and Learning, n.d.) is a set of stan- 
dardized, individually administered measures 
of early literacy. The measures are designed 
to be short (one minute) and are used to regu- 
larly monitor the development of pre-reading 
and early reading skills. The DIBELS meas- 
ures include: Initial Sound Fluency (ISF), 
Letter Naming Fluency (LNF), Phonemic 
Segmentation Fluency (PSF), Nonsense Word 
Fluency (NWF), Oral Reading Fluency 


“The district conducted re- 
search to find a measure de- 
signed to elicit that data neces- 
sary to make informed decisions 
about student progress in early 
reading and DIBELS was se- 
lected.” 

V J 

(ORF), and Retell Fluency (RF). Three times 
per year, reading teachers administer appro- 
priate DIBELS subtests (universal screening) 
and on a bimonthly basis, they assess students 
receiving more intense or tiered instruction 
(progress monitoring). 

Data-driven Instruction and Fidelity of 
implementation 

The need and methodology for data- 
driven instruction in general, and with RTI 


specifically, has been well documented 
(CEC, 2007; and Mellard & McKnight, 
2006). Although much works remains in 
this area (e.g., especially skill areas other 
than literacy), research-based methodolo- 
gies and protocols are available. However, 
an area of continuing concern for many 
professionals implementing RTI is fidelity 
of implementation or treatment integrity. 
Here the effort is to ensure that teachers 
are delivering instruction or a program in 
the way in which it was designed or in- 
tended (Gresham, MacMillan, Boebe- 
Frankenberger, & Bocian, 2000). 

1. Data-driven Instruction 

As a veteran general education 
teacher, Ms. Sullivan had used a best prac- 
tice cycle of instruction: pre-assess, teach, 
post-assess, and reflect for years. But, in 
the past, she made those decisions based 
upon a class score, a group mean score, 
selected student scores, and observations. 
She assigned test or course grades and 
moved on to the next chapter or unit of 
study. Today they do not say, I taught the 
material.” Or “I gave the grade.” Now, 
Ms. Sullivan and Ms. Easton want to know 
how much each student learned and to 
identify what is necessary to improve stu- 
dent’s skill levels. This paradigm shift has 
taken time and effort on everyone’s part 
and it continues to be refined. 

Benchmark assessment in the five, 
essential elements of reading occurs (Na- 
tional Reading Panel, 2000) using the 
DIBELS and the Fountas and Pinned 
Benchmark Assessment System (BAS). 
This process caught students before they 
failed a subject and referred them for fur- 
ther assessment or more intense instruc- 
tion. 
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2. Fidelity of Implementation 

Probably the most challenging goal 
the district initially established was to main- 
tain and assure fidelity of implementation. 
Fidelity of implementation is the delivery of 
instruction in the way in which it was de- 
signed and intended to be delivered 
(Gresham, MacMillan, Boebe-Frankenberger, 
& Bocian, 2000). Fidelity of implementation 
or treatment integrity requires that teachers 
provide instruction and progress monitoring 
according to the research-based method pre- 
scribed or to a best-practice protocol. 

Some researchers have called for the 
need for research in the area of teacher fidel- 
ity within the RTI model. Noell and Gansle 
(2006) reveal that implementation of inter- 
ventions have received little attention in the 
RTI literature and emphasize the necessity of 
documenting that interventions were in fact 
implemented. They further assert that even 
with high quality pre-intervention assess- 
ments, intervention design, progress monitor- 
ing, and data evaluation, the system must 
guarantee implementation of the intervention 
as intended. Without this the system becomes 
a hollow shell that produces meaningless out- 
comes. Failure to truly implement the re- 
quired interventions subverts RTFs main goal 
of providing services at the point of concern 
without having to wait for a formal assess- 
ment or evaluation. 

Similarly, Fuchs and Deshler (2007) 
contend there are many unanswered questions 
that need to be examined and considered 
when implementing RTI. These researchers 
urge districts, schools, and administrators to 
set expectations for the implementation of 
RTI, provide adequate resources, and support 
the use of procedures that ensure fidelity of 
intervention. Further, Fuchs and Fuchs (2006) 
and the Instructional Research Group (2006), 


and others argue that implementation fi- 
delity is a key issue in RTI. 

Another rationale for ensuring fi- 
delity of implementation is that it paves 
the way for a more valid determination of 
the existence of a disability. Is Gregory a 
student with a specific learning disability? 
Or, does Gregory just need additional in- 
struction in reading decoding and fluency? 
The intervention team needs to determine 
whether a student has received appropriate 
instruction in the general education class- 
room. Implementing instruction with fidel- 
ity satisfies one of IDEA’S legal require- 
ments for appropriate instruction (IDEIA, 
2004). Several authors corroborate the im- 
portance of fidelity of implementation to 
maximize program effectiveness (e.g., 
Foorman & Moats, 2004; Gresham, et al., 
2000; and Telzrow, McNamara, & Hollin- 
ger, 2000). 

Although both common sense and 
research support the concept of fidelity of 
implementation to ensure an intervention’s 
successful outcome, the practical chal- 
lenges associated with achieving high lev- 
els of fidelity are well documented 
(Gresham, et al., 2000). Direct and fre- 
quent assessment of an intervention for 
fidelity is considered to be best practice. 
When researching the effectiveness of an 
intervention, it is critical to be able to re- 
port the fidelity with which it was imple- 
mented so that any resulting gains in stu- 
dent achievement can be accurately attrib- 
uted to the intervention under investiga- 
tion. Failure to make this attribution might 
block the replication of an important inter- 
vention. When implementing an interven- 
tion, it is critical to know whether it is be- 
ing implemented as designed, so that if the 
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intervention is initially unsuccessful, schools 
can take appropriate measures to remedy the 
deficiency rather than abandoning the entire 
reform. 

Three specific mechanisms were im- 
plemented to enhance fidelity of implementa- 
tion in this district. Each mechanism was also 


intended to support teachers’ efforts to en- 
hance data-driven instruction. The three 
supports to improve fidelity of implemen- 
tation were use of: (A) a form to track 
what was occurring during instruction, (B) 
reading coaches, and (C) video clips. 


Figure 1 - Student Intervention Tracking Form 


Student: Grade: Teacher: == 

Beginning DIBELS Scores (list scores available): 

ISF: LNF: PSF: NWF: ORF: RF: Tier: 


Targeted Skill(s) for this cycle: 


Week of 

Date Length # of Students 

Intervention Attempted 

in mins, per group and 
any deviations 

Observations 
of student’s 
response to 
intervention 

DIBELS 

Prog. Mon. Scores* 







ISF: 

PSF: 

NWF: 

ORF: 







ISF: 

PSF: 

NWF: 

ORF: 







ISF: 

PSF: 

NWF: 

ORF: 


Teacher’s Summary of Student Response to Intervention: 


Highlight any deviations from the intervention plan: 


RTI Team - Tier Placement for Next Cycle: Date of next meeting 
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A. Student Intervention Tracking Form 

Building upon research of teacher logs 
and tracking of intervention techniques 
(Rowan, Cambum, & Correnti, 2004; and 
Telzrow, McNamara, & Hollinger, 2000), the 
Student Intervention Tracking Form was de- 
veloped not only to provide specific student 
data upon which decisions of rate and slope 
of progress could inform decisions, but also 
to enhance teacher fidelity of implementation. 

As noted above in Figure 1 - Student Inter- 
vention Tracking Form, teachers document 
for each student: (1) interventions attempted, 
(2) frequency (# of days/week), (3) duration 
(# of minutes/session), and (4) intensity (in- 
dividual or # of students/group), and (5) stu- 
dent response to the intervention; thus, en- 
hancing the chance that what was intended to 
be taught is taught and improving teacher fi- 
delity of implementation. Further, the section 
entitled, “Highlight any deviations form the 
intervention plan.” focuses the teacher on 
whether the instructional protocol was fol- 
lowed and requests identification of any 
changes in that protocol. 

B. Reading Coaches 

Another support for fidelity of imple- 
mentation included the use of reading 
coaches. Each week, the Reading Coach (a 
former reading teacher or reading specialist) 
reviewed the Student Intervention Tracking 
Form of students receiving tiered instruction. 
If a teacher was particularly challenged with a 
student’s lack of progress, was not imple- 
menting interventions as prescribed, or was 
not recording those interventions, the coach 
would offer assistance. Reading coaches can 
provide demonstration lessons, discuss alter- 
nate ways to enhance an intervention, or 
coach a teacher in any way they mutually 


agree would enhance fidelity of instruc- 
tion. 

C. Video clips 

In addition to the “Student Inter- 
vention Tracking Form” and Reading 
Coaches, and following the advice of Gus- 
key (1999) and Knight (2009), school ad- 
ministrators built a partnership approach to 
increasing high-quality teacher implemen- 
tation of best practices. One technique 
recommended by these researchers that 
was particularly powerful was the use of 
video clips taken of teachers in the pilot 
year as they implemented specific aspects 
of data-driven, tiered, research-based in- 
struction. Specifically, since video cam- 
eras were readily available in the school, 
the school used the opportunity to train the 
teaching assistants to record lessons during 
tiered instruction. The school then took the 
video clips teachers felt were particularly 
instructive and burned them on disks, to be 
categorized, and shared throughout the 
district for easy viewing by peers. At the 
end of each marking period, the school 
distributed a list of the clips most helpful 
in selected areas. This provided encour- 
agement for additional taping and to rein- 
force viewing. 

Websites 

Although they were not specifi- 
cally a component of fidelity of interven- 
tion, the use of helpful websites provided, 
substantive support for implementing RTI. 
They provided numerous ideas for RTI 
implementation and research-based in- 
structional methodologies. The school in- 
cluded these websites in most professional 
development sessions and encouraged 
teachers to share specific applications and 


utilizations with grade-level teams and their 
school principal. School principals kept these 
suggestions and shared them bi-monthly. See 


Figure 2 - Helpful, “free” (your tax dollars 
at work) Websites. 


Figure 2 - Gray Box item 

Helpful, “Free” (your tax dollars at work) Websites 

1 . National Center on Response to Intervention 
http://www.rti4success.org/ 

This free site is supported by the US Department of Education, Office of Special Educa- 
tion Programs, the National Center on Response to Intervention (RTI) provides informa- 
tion to individuals and technical assistance to state educational agencies across the country 
about RTI. 

2. Institute of Education Sciences (IES) - National Center for Educational Evaluation and 
Regional Assistance 

http://ies.ed.gOv/ncee/wwc/publications/practiceguides/#rti 

Spring of 2009 two practice guides on RTI were released, one on reading and one on 
mathematics. Other helpful information ranges from improving adolescent literacy to 
reducing behavior problems at the elementary school level. 

3. National Center on Student Progress Monitoring 
http : //www. studentpro gres s . or g/ 

This site provides information on the scientifically based practice of screening and moni- 
toring students' skill development. Many different tools are available. 

4. What Works Clearinghouse 
http : //www. whatworks . ed. gov 

No Child Left Behind mandates evidence-based practices be used to assure use of 
research-based instructional methodologies in classrooms. This site is a source for 
evidenced-based practices. 

5. Florida Center on Reading Research 
http : //www. fcrr. org/Interventions/index . htm 

This site provides multiple intervention ideas linked to the five essential components of 
effective early reading instruction. Interventions for individuals or small groups can be 
printed in their entirety. 


Conclusions 

This school district has made four se- 
lected findings concerning the RTI model: (1) 
improved student outcomes in most areas of 
literacy, (2) declining rates of referral to the 
child study team for assessment, (3) decreas- 
ing numbers of students classified as needing 
of special ed„ and (4) positive feedback from 
teachers who have worked with this RTI 


model. These findings have maintained the 
momentum and justified the expansion on 
this RTI model into other skill and behav- 
ioral areas. 

The percentage of increase in 
DIBELS scores for selected measures in- 
creased significantly over the past three 
years (multivariate ANOVA at the .05 
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level). The initial data coming from the use of 
the Fountas and Pinnell Benchmark Assess- 
ment System (BAS) are encouraging. BAS 
percentile scores have increased overall from 
the previous year by eight percentile points 
for students assessed in Tier II. 

In addition, both the number of refer- 
rals requesting child study team evaluations 


and the classification rates of students de- 
termined eligible for special education 
services has decreased. As seen in Table 
1, the percents of decline for 2007- 2008, 
were -16% and -23% respectively with 
reductions in both rates. 


Table 1 - Student Referral and Classification Rates 
School year Rate of Student Referral Student Classification Rate 


2005-2006 

- 2.25 % 

- 1 . 8 % 

2006-2007 

- 11 . 5 % 

- 9 . 4 % 

2007-2008 

- 16 . 3 % 

- 26 . 2 % 


Without the progress in reading 
benchmark scores, the decrease in the number 
of referral and classification rates might be 
attributed solely to those components of RTI 
that could be perceived as a delay tactic, a 
caution noted by CEC (2007). In light of the 
improved DIBELS and BAS scores, however, 
the decrease could, in part, be attributed to 
implementation of this RTI model. From the 
results of a survey, most administrators and 
teachers feel this is “largely” due to the (1) 
implementation of RTI, (2) use of benchmark 
assessments and progress monitoring, and (3) 
additional professional development and 
training. 

Lastly, teachers were queried for 
anonymous feedback about their level of sat- 
isfaction with various aspects of the district’s 
RTI model. The results showed 83-91 per- 
cent “agree” or “very much agree” there had 
been significant progress. The one theme 
found in the comment section that continues 
to be addressed is the commitment of time 
required by teachers. Change is never easy 
and often requires teachers and administrators 
additional time and energy to achieve success. 


Evaluators of RTI continue to be con- 
cerned about the difficulties with data col- 
lection and how it is used to inform in- 
struction as well as with the fidelity of the 
implementation of interventions. 

Status of Scenario for Gregory 

After reviewing Ms. Sullivan and 
Ms. Easton’s Student Intervention Track- 
ing Forms, for Gregory and discussing his 
strengths and areas of need, the Interven- 
tion Team recommend his teachers, with 
support from the reading coach, provide 
instruction in sound-symbol recognition, 
blending of selected sounds identified by 
the tracking forms, and repeated readings 
of first grade level books to raise Greg- 
ory’s fluency from 23 to 53 words correct 
per minute. After eight weeks of instruc- 
tion in these areas, the intervention team 
will meet again to review his progress and 
determine the next step. 

Summary 

As teachers, administrators, and 
members of intervention teams use student 
performance data to inform instructional 
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decisions and monitor the fidelity of imple- 
mentation of tiered instruction in a Response 
to Intervention (RTI) model, ways to assure 
fidelity of implementation or treatment integ- 
rity continues to be a challenge. Three 
mechanisms to enhance data-driven instruc- 
tion and fidelity of implementation in an RTI 
model in one school district include the use 
of: (1) a tracking form to document what was 
occurring during instruction and when, (2) 
reading coaches to support teacher’s interven- 
tions, and (3) teacher-made video clips to 
provide models and documentation of instruc- 
tional implementation. 
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